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Component User Interface Management 



FIELD OF THE INVENTION 

The invention relates to user interface components of saftware applications. In 
particular, the invention relates to a system and method for a user interface framewoik 
manager. 

BACKGROUND OF THE INVENTION 

Historically, software applications (applications) are shipped with a predefined 
set of tools. For example, in Corel (TM) PhoroPaint (TM) there is a brush tool, an 
eraser tool, a mask tool, etc. With the increase in the use and capability of the 
Internet, application models have changed. Rather than shipping an application with a 
fixed set of tools, users can now download new tools (or components) which attach 
themselves to the application to augment its feature set. 

This flexibility means that multiple configurations of the application can be 
shipped with different tool components to meet varying sales markets. It also means 
that users can buy an inexpensive version of the product with few tool components 
and then grow their tool set by selectively buying the ones for their particular needs. 
Trial tool components are also possible for users ro demo but will time-out after a set 
time if the user does not decide to purchase it. 

Each component can bring with it a whole set of user interface (UI) items, 
toolbars, menus, dockers and shortcut keys that the application user interface 
framework must be able to recognize and seamlessly integrate into its current layout 
when the component is loaded. On top of this, any particular application user 
interface, or workspace can be shared with fellow users and this sharing must account 
for the possibility that a particular component may not be registered on the new user 
system, 

Currently tfciere are a number of architectures by different vendors that support 
components which add their own user interface items to the application. None of 
these, however, provide a complete, customi2able UI component system that is 
managed at the application framework level. These known architectures require each 



i. 



-2- 

component TO manage the portions they add themselves. 

Problems associated with the current art may be divided into wo groups: i) the. 
component Ul is treated differently than the application UI; and ii) component UI 
problems when loading or unloading components, and missing components. The 
5 following are a number of component UI problems that exist with the current 
architectures: 

ij Component Ul is treated differently than application UI: 

1) Some architectures only allow components to add toolbar buttons 
or menu items and do not allow more complex UI elements like combo 

1 0 boxes, edit connote, sliders, shortcut keys, shortcut Key tables, 

toolbars, menus, dockers, etc, This is a problem since it limit? the 
component TP what it pan #44 to The application. Many components 
need to have more complicated user interface controls other than 
buttons. For example, a bitmap transparency component could use a 

1 5 slider control on a toolbar to allow die user to adjust the transparency 

value. 

2) Some architectures do not allow the user to customize all of the 
individual component UI elements such as an item location, caption 
text, tooltip text, bitmap, item size, shortcut key, toolbars, menus, 

20 dockers, etc. This is a problem since not only does it limit the user 

from fully customizing the user interface it limits other third parry 
developers from creating custom solutions for clients. 

3) Some architectures treat component UI with a different status 
than the regular application UI by not allowing the component UI to 

25 add itself anywhere into the application UI- The component UI is 

restricted to one location in a menu or toolbar. This is a problem since 
it fragments rhe UI rather than merging it seamlessly together, 
ii) Component UI problems when loading or unloading components, and 
missing components: 

30 4) Some architectures can only add or remove component UI by 

shutting down the application and restarting. This is a real 



inconvenience to the user and gives the application an unprofessional 
impression to the user. 

5) Some architectures allow components to add their UI but do not 
remove the UI when the component is unloaded. Instead the UI 
remains visible for the user to select and then brings up a dialog box 
saying thar this feature is not available. If the UI is to be removed it is 
left up to the individual component to do so. Leaving UI from 
unloaded components gives the application a cluttered and 
unprofessional impression to the user. 

6) Some architectures can remove xhe component UI items when the 
component is removed but do not remove any that were customized by 
the user. For example, if the user copied a component button to a 
different toolbar, the copied button will not be removed when the 
component is unloaded. If the user selects it, the feature is not 
available. These architectures leave it up to the component to 
specifically search for these customization* and remove them. This too 
leaves the application clutrered and gives it an unprofessional 
impression to the user. 

7) Architectures that rely on the unloading components to remove all 
of their UI and any user customizations also rely on the components to 
restore those customizations if they are later reloaded. Heaving this up 
to each of the components puts a great burden on them and they are not 
all likely to do it right If any of them do not do it properly it will 
confuse the user due to the inconsistent behaviour between various 
components., 

8) Some architectures allow users to share their UI with fellow 
users. If the UI happens to contain UI elements from a component that 
the new user does not have loaded, the UI does not disappear but is 
visible for the user to select. Again, this is a problem since the UI is 
visible but the feature is not available. This gives the application an 
unprofeseipnal impression to the user. 
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The following is a list of current component architectures as well as & note W 
where each one fails to solve the component UI problems: 

1) Bitmap plugins do not solve problems 1, 2, 3, and 4 listed above, 

2) Addins do not solve problems 1, 2, and 4 listed above. 

5 3) VBA Object Models do not solve problems 5, 6 a 7, and 8 listed 

above. 

4) WordPerfect (TM) 3* Party Handlers do not solve problems 1, 6, 
and 8 listed above. 
There is a need for an architecture that solves the above listed problems. 

10 

SUMMARY OF THE INVENTION 

The invention described tn this document solves many of the above listed 
problems at the application framework level to support customizable component user 
interface (UI) that are merged seamlessly into the application UI. The invented 
i 5 architecture knows when the component is available and remembers all 

customizations even when it is not there so that when the component is re-added the 
customizations are restored. 

In accordance with an aspect of the invention, there is provided a user interface 
framework management system for managing ihe user interface of a software 

20 application. The user interface framework management comprises a merged 

application user interface for receiving a software application user interface element 
of the software application and a component user interface element of a component to 
be included with the software application, a unification unit for merging the 
component user interface element with the software user interface element into the 

25 merged application user interface, and an identification unit for associating the 

component with the component user interface element in the merged application user 
interface. 

In accordance with another aspect of the invention, there is provided a method 
for managing the user interface framework of a software application when installing a 
30 component in a software application. The method comprises steps of receiving a 
software application user interface element of the software application and a 
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component user interface element of the component in a merged application user 
interface, merging the component user interface element with the software user 
interface element into the merged application user interface, and associating the 
component with the component user interface element in the merged application user 
5 interface. 

In accordance with another aspect of the invention, there is provided a method 
for managing die user interface framework of a software application when unloading a 
component from a software application. The method comprises steps of receiving a 
software application user interface element of the software application and a 

10 component user interface clement of the component in a merged application user 

interface, the component being associated with the component user interface element, 
and disassociating the component from the component user interface element in the 
merged application user interface. 

In accordance with another aspect of the invention, there is provided a method 

15 for managing the user interface framework of a software application when reloading a 
component from a software application. The method comprises steps of receiving a 
software application user interface element of the software application and a 
component user interface element of the component in a merged application user 
interface, the component being disassociated with the component user interface 

20 element, and re-associating the component from the component user interface element 
in the merged application user interface. 

In accordance with another aspect of th£ invention, there is provided a j 

i 

computer data signal embodied in a carrier wave and representing sequences of 

instructions which, when executed by a processor, cause the processor to perform a j 
25 method for managing the user interface framewoik of a software application when 

installing a component in a software application. The method comprises steps of j 
receiving a software application user interface element of the software application and 
a component user interface element of the component in a merged application user 
interface, merging the component user interface element with the software user 
30 interface element into the merged application user interface, and associating the 
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componenr with the component user interface element in the merged application user 
interface. 

In accordance with another aspect of the invention, there is provided 
computer-readable media for storing instructions or statements for use in the 
5 execution in a 

computer of a method for managing the user interface framework of a software 
application when installing a component in a software application. The method 
comprises steps of receiving a software application user interface element of the 
software application and a component user interface element of the component in a 

10 merged application user interface, merging the component user interface element with 
the software user interface element into the merged application user interface and 
associating the component with the component user interface element in the merged 
application user interface. 

In accordance with another aspect of the invention, there is provided a 

15 computer program product for use in the execution in a computer for creating a user 
interface framework management system for managing the user interface of a 
software application. The user interface framework management comprises a merged 
application user interface for receiving a software application user interface element 
of the software application and a component user interface element of a component to 

20 be included with the software application, a unification unit for merging the 

component user interface element with the software user interface element into the 
merged application user interface, and an identification unit for associating the 
component with the component user interface element in the merged application user 
interface. 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a diagram showing an example of a software application 
environment. 

Figure 2 is a diagram showing an example of a user interface framework 
30 manager. 

Figure 3 is a flow chart showing an example of the operation of a user 
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interface framework manager when loading a component to an application. 

Figure 4 is a flow chart showing an example of the operation of a user 
interface framework manager when unloading a component from an application. 

Figure 5 is a flow chart showing an example of the operation of a user 
5 interface framework manager when reloading a component from an application. 

Figure 6 is another flow chart showing an example of the operation of a user 
interface framework manager when loading a component to an application. 

Figure 7 is a partial screen shot showing a component added to an application. 

Figure 8 is a partial screen shot showing another component being added to an 
10 application. 

Figure 9 is a partial screen shot showing two components added to an 
application. 

Figure 10 is a partial screen shot showing a customized component to an 
application. 

1 5 Figure 11 is a partial screen shot showing a component has been removed. 

Figure 12 is a partial screen shot showing a re-added component. 

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

Figure 1 shows an example of a software application environment 100. The 

20 environment includes an application 10 1 , components 103, and a user interface (UI) 
framework manager 200. The application 101 contains application Ul elements 102. 
For example, each toolbar, menu, docker, button, slider, etc, are UI elements. Each 
component 103 contains component UI elements 104. The UI framework manager 
200 contains a merged application UI 201. 

25 The application 1 01 is built on top of the UI framework manager 200 which 

manages the component UI elements 104 and the application UI elements 102. 
When a component 103 submits its UI elements 104 to the application 101, the 
application 101 in turn gives the component UI elements 104 to the UI framework 
manager 200 to handle. Another way is for the component 1 03 to submit its 

3 0 component UI elements 1 04 directly to the UI framework manager 200. 
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In one embodiment of the invention, individual components 103 are loaded 
into the application 101. Once loaded they submit their user interface elements 104 
and the application 101 uses a 111 framework manager 200 to manage them (see 
Figure I), This UI framework manager 200 is responsible for coordinating the UI 
5 elements that come from either the application 101 or the individual components 103. 

Figure 2 shows a UI framework manager 200 comprising a merged application 
UI 201, a unification unit 202 and an identification unit 203, Through its unification 
unit 202, the UI framework manager 200 takes the component UI elements 103 along 
with the application UI elements 102 and unites them together to form a seamless 

10 application UI, i.e., merged application UI 20 1, for the user. Component UI elements 
like buttons, sliders, drop down lists, etc may be added to existing application 
toolbars, menu, etc. Or the component may add its own toolbars, menus, etc. which 
will be placed in the UI just like regular application toolbars, menus, etc. Once a 
component 103 has added its component UI elements 104 to the application 101, the 

15 component UI elements 104 are nor segregated and given special status. Instead, the 
component UI elements 104 becomes an equal pan of the merged application UI 201. 

Since there is one central UI framework manager 200 9 any UI feaiure available 
to the application 101 is also available to e^ch of the loaded components 103. This is 
possible since the UI framework manager can fully manage all the UI elements no 

20 matter what type they are or where they originated from. This means that a 

component's UI elements 104 could include any type of UI element, such as drop 
down lists, edit controls, sliders, shortcut keys, shortcut key tables, toolbars, menus, 
dockers, etc., and is not limited to only toolbar buttons or menu items. This solves the 
first component UI problem listed above. Furthermore, added components are no 

2$ longer limited to just adding buttons but can add the same type of UI as the 

application can add, Previous architectures that fail to solve component UI problem 
one ? cannot provide support for this flexibility. 

As already mentioned, the UI elements, whether from the application 101 or 
from a component 103, are treated the same. This means that the component UI 

30 elements 104 may be placed anywhere in the application UI 201, and are not restricted 
to particular menus or toolbars. The UI framework manager 200 supports this 
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flexibility by allowing individual UI elements, from both the components 103 and the 
application 101, to specify on which toolbar, menus, etc., they should be placed. 
Componenr UI elements 104 may also be fully customized by the user just like the 
regular application UI elements 102. Once the UI elements have been merged into the 
5 merged application UI 201 there is no longer a division between component UI 
elements 104 and application UI elements I 02. The UI framework manager 200 
allows each element to be fully customized including changing its label, bitmap, 
shortcut key, location, tooltip, etc, This solves the second and third component UI 
problems listed above. 

10 Since the UI framework manager 200 treats the component UI elements 104 

and the application UI elements 102 the same way, the first three component UI 
problems listed above have been solved. However, it is also desirable for the UI 
framework manager 200 to be able to distinguish between the components so that it 
may manage component loading* unloading, and UI sharing, as well as managing 

15 missing components. 

To do this, the UI framework manager 200 assigns ownership to each of The 
added component UI elements 104, through its identification unit 203 when the UI 
elements are merged into the merged application UI 20L That is, every button, drop 
down list, toolbar, menu, etc. is given a tag that identifies which component 103 

20 added it to the merged application UI 201. This component 103 is then considered to 
be the owner of that UI element in the merged application UI 201. The ideg. of 
ownership solves component UI problems four through eight listed above. This 
solution is further described below. 

When a component 103 is loaded into the application 101, the component 103 

25 submits its component UI elements 104 to the application 101, The application 101 
gives the component UI elements 104 ro the UI framework manager 200. The UI 
framework manager 200 assigns the owner identification to the component UI 
elements 104 that are added to the merged application UI 201 . It will also assign the 
owner identification to the application UI elements that are added to the merged 

30 application UI 201. If the component 103 is later unloaded, the UI framework 

manager 200 searches through the merged UI elements 201 and removes any That are 
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owned by that component 103. This allows components 1 03 to be dynamically 
loaded and unloaded while the application 101 is running. The application does not 
need to be restarted since the unloaded component's UT elements that were apart of 
the merged application UI 201 are now removed. Similarly when a component 103 is 
added to a running application, die UI framework manager 200 merges the 
component's UI elements 104 into the merged application UI 201. The application 
does not need to be restarted. In addition, since the UI framework manager 200 
searches for the unloaded component's UI in the merged application UI 201 to 
remove them, it also means that the component UI elements 104 that a component 103 
added, including those that a user has customized with diflereitf properties and 
different locations, will also be removed when the component 103 is unloaded- This 
solves component UI problems four, five and six listed above. 

Although unloaded component UI elements 104 are invisible to the user, they 
are not completely removed. The UI framework manager 200 hides all component UI 
elements in the merged application UI 201 that are identified with an unloaded 
component 103 from being accessed, but keeps the customization internally for 
future use. If the component 103 is later reloaded, its component UI elements in the 
merged application UI 201 > including any customizations, will automatically be 
restored. This solves component UI problem number seven listed above. 

If one user, who had a particular component 103 loaded, shared their 
application UI 102 setup and all its customizations with another user, that other user 
would only see the component UI elements in their merged application UI 201 for 
which there was support. That is, if the new user did not haye a particular component 
103, its component UI elementsl04 specified in the shared merged application UI 
elements 201 would not be visible or accessible. The UI framework manager 200 
accomplishes dais by checking if each UI element in the merged application UI 201 
may be created by its owner component 103 or application 101. In this example, the 
UI elements in the merged application UI 201 from the missing component may not 
be created since the component is not loaded. If, however, that user later loaded the 
missing component 103, the component UI elements 104 would appear in the manner 
that the original user had customized it. This is possible since the UI framework 
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manager 20Q maintains all the customizations that were made to items even if they 
can not been shown. Once the owning component 103 is loaded, the UI framework 
manager 200 will then use these stored customizations and show the UI exactly how 
the first user had them. This solves component UI problem number eight listed above. 
5 Figure 3 shows a flowchart of the installation of a new component 103. When 

a component 103 is installed into the application 101, The application 101 receives the 
component UI elements 104 (301). The application 101 passes the component UI 
elements 104 to the UI framework manager 200 (302). The unification unit 202 of the 
UI framework manager 200 -unites the component UI elements 1 04 with the 

10 application UI elements 102 into a merged UI 201 (303). Next, the identification unit 
203 of the UI framework manager 200 assigns ownership to the component UI 
elements 104 in the merged application UI 201 to the component 103 (304). The 
component 103 is now added to the application 101 (305). 

Figure 4 shows a flowchart of the request to remove a component 1 03 from 

15 the application 10 1. Once a request to unload the component 103 is made, the UI 
framework manager 200 searches through the merged application UI 201 for 
component UI elements 104 that have been assigned ownership to the component 103 
(402). The UI framework manager 2Q0 hides each component UI element 104 owned 
by the component 103 (403). The component 103 is now unloaded from the 

20 application 101 (405). 

Figure 5 shows a flowchart of the request to reload a component 103 
previously removed from the application 101. Once a request to reload the 
component 103 is made, the UI framework manager 200 searches through the merged 
application UI 201 for hidden component UI elements 104 that are assigned 

25 ownership to the component 103 (502). The UI framework manages 1 200 restores each 
component UI element 1 04 hidden from the application 101 (504). The component 
103 is now reloaded into the application 101 (505). 

Figure 6 shows another flowchart of the installation of a component 103. 
When a component 103 is installed into the application 101, the application 101 

30 receives the component UI elements 104 (601). The application. 101 passes the 
component UI elements 104 to the UI framework manager 200 (602). The UI 
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framework manager 200 first searches to see if the component 103 is being bidden 
(603). If so, then the Ul framework manager 200 restores the component 103 (604) as 
described above in Figure 5. Otherwise, the component 103 is loaded as described 
above in Figure 3 by submitting its component UI elements 104 to the LJI framework 
manager 200 (605). 

Figures 7 through 12 are screen shots showing an example of a FrmWkTest 
program 700 which is a sample test application with two tool components: the ellipse 
701 and the rectangle 703. Both components add one burton to the toolbox on the left 
side when they are loaded. The figures demonstrate the seamlessness of component 
Ul elements 104 in die application with respect to loading and unloading components 
1 03, customization and missing components. 

Figure 7 shows the FrmWkTest application 700 has just loaded with the 
ellipse component 701 adding one ellipse button 702 to the toolbox 705. Figure 8 
shows the rectangle component 703 is now being dynamically loaded into the test 
application 700. Figure 9 shows the rectangle component 703 has now loaded and has 
added the rectangle tool button 704 to the toolbox 705. Figure 10 shows that the user 
is now free to customize the component elemenrs 104 that have been merged into the 
application UI 201 just like any other application Ul element 102 that has been 
merged into the application UI 201 . In this case, the rectangle tool button 704 was 
copied several times onto the standard toolbar 706. If the user unloaded the rectangle 
component 703, all component UI elements in the merged application UI 201 that it 
owned would be removed including the rectangle tool button 704 in the toolbox 705 
and the customized buttons 705 in the standard toolbar 706. Figure 1 1 shows that if 
the user later launches that application 101 without the rectangle tool component 703 
or shares the merged application UI 201 layout with another user who does not have 
the rectangle tool component 703, the rectangle tool component's 703 UI elements 
704 will not appear in the second user's merged application UI 201. The customized 
UI elements 704 are remembered internally but not shown to the user since the 
component 703 to support them is not available. Figure 12 shows that if the rectangle 
component 703 is later loaded, its component UI elements 704 and the customizations 
will appear as before. % \ 
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Tbe UI framework manager 200 has several advantages. One advantage is that 
the UI framework manager 200 promotes component UI elements 104 so that they are 
not given second class status but are treated equally with the rest of the application UI 
elements 102 with regard to content, customization and location within the merged 
5 application UI 201 . This allows for complex components that cao add significant 
value to an application 101. 

Another advantage of the UI framework manager 200 is that by having 
seamless interaction between multiple component UI elements 104 and the 
application UI elements 102 in the merged application UI 201, the user does not feel 
1 0 constrained by limitations and may view the entire merged application UI 201 as a 
complete whole. One consistent UI approach makes the application 101 easier to use. 

Another advantage of the UI framework manager 200 is that component UI 
elements 104 are managed by the UI framework manager 200, allowing components 
1 03 to be loaded and unloaded with all the component UI elements 1 04, including 
1 5 those that were customized. The benefit here is that the UI framework manager 200 
provides one complete solution rather man leaving it up to each individual component 
103 to manage its own UI elements 104. 

Another advantage of the UI framework manager 200 is that by providing a 
robust component Ul framework manager 200, applications 101 may now rely on this 
20 technology and be shipped with various tool components 1 03 for different sales 
markets. 

Another advantage of the UI framework manager 200 is that the UI framework 
manager 200 also allows new components 103 with their UI elements 104 to be 
downloaded from the Web and managed even after customers have purchased the 
25 application 101. Thus potential sales may be expanded to previous customers who 
just want to get the latest feature but do not want to do a full upgrade. 

While specific embodiments of the present invention have been described, 
various modifications and substitutions may be made to such embodiments. Such 
modifications and substitutions are within the scope of the present invention, and are 
30 intended to be covered by the following claims. 
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